Camera apparatus with magnified playback features

ABSTRACT

An embodiment of a camera apparatus includes transferring a compressed playback streaming signal output from a recording medium to a map defined in a memory circuit, decoding the transferred playback streaming signal by a decoder, converting the decoded signal to a YUV signal in an image processing unit, transferring the converted signal to the map as a YUV signal, generating a magnified or reduced image from the YUV signal in the image processing unit, and storing the image on the map, overlaying a magnified or reduced image prepared on the map according to a magnified playback request, and outputting the overlaid image for seeking an output position.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of co-pending U.S. application Ser.No. 11/393,876, filed Mar. 31, 2006, and for which priority is claimedunder 35 U.S.C. §120. This application is based upon and claims thebenefit of priority from Japanese Patent Application No. 2005-104426,filed Mar. 31, 2005, the entire contents of all applications areincorporated herein by reference in their entireties.

BACKGROUND

1. Field

One embodiment of the invention relates to a camera apparatus which candisplay a magnified or reduced image during playback, and in particular,a desired part of a still or moving image taken by a camera apparatussuch as an electronic camera.

2. Description of the Related Art

A camera apparatus can record still and moving images in a recordingmedium, such as a semiconductor memory (a memory card) and a hard discunit.

A taken image is displayed (played back) in a liquid crystal displayprovided integrally with a camera apparatus, a display unit capable ofdisplaying a video signal, that is, a display unit used in a personalcomputer, or an ordinary television set, by the user by operating thecamera apparatus.

Nowadays, as a camera apparatus and a large-screen television (monitor)have become widespread, partially magnified playback of a recorded imageis widely demanded by the user.

Japanese Patent Application Publication (KOKAI) No. 2004-48229 disclosesa display control method that is used when displaying a magnified stillimage in a digital still camera.

However, the Publication 2004-48229 mentions only display of a magnifiedstill image and operations for it, and does not mention magnification orreduction of a desired part of a moving image during playback.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

A general architecture that implements the various features of theinvention will now be described with reference to the drawings. Thedrawings and the associated descriptions are provided to illustrateembodiments of the invention and not to limit the scope of theinvention.

FIGS. 1A and 1B are exemplary diagrams each showing an example of acamera apparatus capable of recording still and moving images andvoices, according to an embodiment of the invention;

FIG. 2 is an exemplary diagram showing a control system of the cameraapparatus according to an embodiment of the invention shown in the FIGS.1A and 1B;

FIGS. 3A and 3B are exemplary diagrams each showing an example of amagnified image during playback of a moving image, setting of displayposition and magnification in the camera apparatus according to anembodiment of the invention shown in the FIGS. 1A, 1B and 2; and

FIG. 4 is an exemplary diagram showing a signal processing system fordisplaying a magnified image and a reduced whole image during playbackof a moving image in the camera apparatus according to an embodiment ofthe invention shown in the FIGS. 3A and 3B.

DETAILED DESCRIPTION

Various embodiments according to the invention will be describedhereinafter with reference to the accompanying drawings. In general,according to one embodiment of the invention, an embodiment of a cameraapparatus includes transferring a compressed playback streaming signaloutput from a recording medium to a map defined in a memory circuit,decoding the transferred playback streaming signal by a decoder,converting the decoded signal to a YUV signal in an image processingunit, transferring the converted signal to the map as a YUV signal,generating a magnified or reduced image from the YUV signal in the imageprocessing unit, and storing the image on the map, overlaying amagnified or reduced image prepared on the map according to a magnifiedplayback request, and outputting the overlaid image for seeking anoutput position.

FIGS. 1A and 1B show schematic illustrations of an electronic cameraapparatus capable of recording still and moving images and sound, towhich an embodiment of the present invention is applicable.

FIG. 1A shows an electronic camera apparatus (an image pickup unit) 1viewed from the camera lens side. The electronic camera apparatus 1 hasa camera lens 11, a flash 12, a shutter button 13 (for a still image),and a remote control receiver 14. The camera apparatus 1 also has anadapter connector (a connection terminal) 15 used for connection with apersonal computer and an external power supply (a charger).

FIG. 1B shows the electronic camera apparatus 1 viewed from the oppositeside of the camera lens 11.

The electronic camera apparatus 1 has a liquid crystal monitor (LCDpanel) 22 and a speaker 23 provided integrally with a frame 21functioning also as a main power switch. The electronic camera apparatus1 also has a main power switch 24 at a fixed position, which is turnedoff at the position where the frame 21 is closed (housed at a fixedposition of the main body of the electronic camera).

The electronic camera apparatus 1 has a record button 25 capable ofinputting instructions (commands) to start and stop recording a movingimage, a jog (JOG) dial 26 capable of inputting instructions (controlcommands) to input operation modes and conditions and select decisions,a set (OK) button 27 capable of inputting an instruction (a controlcommand) to determine (execute) the instruction selected (guided) by thejog dial 26, a zoom bar 28 capable of inputting a control signal forzoom operation to change the angle of an image (the angle to take apicture of a subject) to be taken by the camera lens 11, and a menubutton 29 used to input a control command to display a menu screen.

FIG. 2 shows an example of a control system of the electronic cameraapparatus shown schematically in FIGS. 1A and 1B.

A subject image taken by the camera lens 11 is focused on an imageforming plane of the image pickup element 31, or a CCD sensor, forexample, and converted to an analog signal (taken image data).

The analog signal (taken image data) from the CCD sensor 31 is convertedto a digital signal in an analog/digital (A/D) converter 101 controlledby a CPU (main control circuit) 111, and input to a camera signalprocessing circuit 102.

The camera signal processing circuit 102 performs gamma correction,color signal separation or white balance adjustment for the taken imagedata converted to a digital signal by the A/D converter 101.

The taken image data output from the camera signal processing circuit102, or a recording image taken by the camera lens 11, is input to aliquid crystal panel driver (LCD Driver) 108, and displayed in an LCDpanel 22 (hereinafter called LCD) mounted in the frame 21 (refer to FIG.1B).

The taken image data output from the camera signal processing circuit102 is compressed in a compression/expansion unit 103, when recording,and recorded in a main recording medium, for example, a hard disc unit105 (hereinafter abbreviated as HDD) or an attached removable recordingmedium, for example, a memory card 106, or a nonvolatile memory.

The compression/expansion unit 103 compresses a still image by a knownmethod such as JPEG, and a moving image (a non-still image) by MPEG. Thememory card 106 may use a semiconductor memory called SD card(registered trademark) and Mini-SD (registered trademark).

When playing an image recorded in the HDD 105 or memory card 106, animage read from the HDD 105 or memory card 106 is expanded in thecompression/expansion unit 103, and supplied to a video decoder 107through a memory circuit 104. The image data supplied to the videodecoder 107 is displayed in the LCD 22 through the liquid crystal paneldriver 108.

A not-shown recording media interface is used for the transfer of data(compressed image) with the HDD 105 and memory card 106. A videointerface (Video I/F) and OSD (On Screen Display) processor 121 areprovided in the stage preceding the video decoder 107.

The video interface and OSD processor 121 is used to display a displayframe or a sub-screen as explained later with reference to FIG. 3, whena magnified image of a desired part of an image displayed in the LCD 22is displayed in a display frame or a sub-screen. An image overlaidthrough the OSD 121 is magnified or reduced by an image(magnification/reduction) processor 131.

Naturally, a not-shown work memory (called RAM or cache) is provided forprocessing image data, as firmware of the CPU 111, or as a part of thememory circuit 104, or as an external memory connected to the memorycircuit 104.

Still image or moving image data recorded in the HDD 105 or memory card106 can be transferred to a not-shown external unit, such as a personalcomputer (PC) and a video recorder. An interface controller 109 can beused for the transfer with an external unit. Naturally, a knownstandard, for example IEEE 1394, a parallel bus, a USB (Universal SerialBus) can be used as an interface.

The interface controller 109 is inserted between an optional interfaceand the memory circuit 104. Naturally, a network (LAN) connected througha LAN controller 110 can be used for the transfer of data.

In the HDD 105 as a recording medium, according to the capacity, therecordable number of still images or the time to record moving images(the number of titles) reaches several 100 to several 1000. Thus, a highspeed is demanded to feed the recorded images or titles forward andbackward.

Therefore, the jog dial 26 and OK button 27 permit easy selection ofmany images or titles and setting of operation modes without hassle. (Aneasy-to-use switch such as the jog dial 26 is useful when specifying animage by continuously searching many images or titles.) The contentsinput by the jog dial 26 (by the user's operation), operation states ofthe camera apparatus 1, or display of the menu screen by the menu button29 are combined through the CPU 111, memory circuit 104, image(magnification/reduction) processor 131, video interface and OSD 121,and displayed in the LCD 22.

The OK (set) button 27 gives the CPU 111 information that the button 27is pressed (ON/OFF signal is input). Based on the ON/OFF signal inputfrom the information (the button 27), the CPU 111 determines theimage/title or mode selected by the jog dial 26, and plays theimage/title or sets the mode.

The jog dial 26 sends the CPU (main control unit) 111 information aboutthe rotation angle and speed. The CPU 111 controls the (next) imagedisplay speed based on this information.

The OK (set) button 27 is placed coaxially (concentrically) with thecenter of rotation of the jog dial 26. The OK (set) button 27 can inputthe above-mentioned ON signal when pressed substantially toward thecenter (in the axial direction), and can input a control command(instruction) to scroll an image displayed in the LCD 22 in the presseddirection, when pressed in one of four directions (generally called“up/down/left/right”) dividing the circumference equally into fourparts.

Displaying a magnified image of a specified part during playback of astill image has already been realized in most digital still cameras.

Further, as the part (position) of a whole image that is magnifiedbecomes unclear when an image is magnified, a sub-screen or frame 22-302is simultaneously displayed on the display screen 22-301 of the LCD 22,and a magnified position mark or frame 22-303 is displayed to indicatethe magnified area.

However, when displaying a magnified image while playing a moving image,special playback techniques such as frame-advance or time-lapse (extracta display image at every certain time) from a paused state is requestedin many cases. Namely, if a part of a display screen is magnified whenplaying a moving image, seamless playback becomes difficult.

This proposal enables magnified display and scroll of a moving imagewithout losing the real-time property, that is, overlaying identifyinginformation indicating a magnification changing part of an image on amoving image displayed in a display unit, providing a magnified imagecorresponding to the magnification changing part of the moving imagedisplayed in the display unit, and changing the magnified imagecorresponding to the magnification changing part according to a relativeposition instructed to change when an instruction is given to change amagnification changing part displayed on the moving image displayed inthe display unit and a relative position of the moving image displayedin the display unit.

For example, as shown in FIG. 3A, when the zoom bar 28 of the cameraapparatus 1 is moved to the T (Tele-conversion) side or W (Wide-angle)side during playback of an image with the whole image 22-300 of aplaying image (moving image) being displayed in the LCD 22, the imagedisplayed in the LCD 22 is changed to the whole image 22-301 of amagnified part. In the whole image 22-301 of the magnified part, areduced whole image is simultaneously displayed within a sub-screen orframe 22-302. On the displayed reduced whole image 22-302, a magnifyposition mark or frame 22-303 indicating a magnifying area is overlaid.

When the user instructs (inputs) to move a magnifying area to one of the“up/down/left/right” directions by operating the OK button 27 while themagnified image is being displayed, the magnify position mark 22-303 ismoved within the displayed reduced whole image 22-302.

Relating to the input of the instruction to move the magnify positionmark 22-303, the image displayed in the magnified whole image 22-301 isscrolled.

The reduced whole image 22-303 and magnify position mark 22-303 areerased (returned to the not-overlaid state) simultaneously with thereset of the magnified display mode, when a certain time (e.g., 3 to 5seconds) passes after the stop of the operation of the zoom bar 28 or OKbutton 27.

The above-mentioned partially magnified display during playback of amoving image is executed also in the state that playback of a movingimage is temporarily stopped (paused). This improves the operabilitywhen specifying a magnifying image, or a magnifying object.

Further, when the zoom bar 28 is moved to the T side while a magnifiedimage is being displayed (or subsequent to the operation of the zoom bar28 during playback of an image), magnification (magnifying power) isincreased. When the zoom bar 28 is moved to the W side, magnification isdecreased. When magnification is increased to higher than apredetermined magnification (when the zoom bar 28 is moved to the Tside), a magnifying image is temporarily created from an image with amaximum magnification or an image with a predetermined magnificationamong the transferable images, by pixel interpolation in an image(magnification/reduction) processing circuit explained below withreference to FIG. 4.

FIG. 4 shows the configuration and signal flow to enable magnifieddisplay of a desired part of an image during playback of a moving imageshown in FIGS. 3A and 3B. The components already explained in FIG. 2 aregiven the same numerals, and a detailed explanation will be omitted. Thesame components as those in FIGS. 1A and 1B are given the same numerals.Here, a continuous image consisting of an optional number of imagestaken within predetermined time is expressed as a moving image.

First, in label [A], an MPEG compressed playback streaming signal outputfrom the HDD 105 (or the memory card 106) is transferred to a map 401 ofthe SDRAM (memory circuit) 104.

Then, in label [B] and label [C], the data is decoded in thecompression/expansion unit (MPEG codec) 103, and converted to a YUVsignal for video display, and transferred to a map 402 of the SDRAM 104,as a YUV signal.

The YUV signal, when displayed without modifying, is given OSD (here,the data corresponding to the frame of the sub-screen 22-302 on thedisplay 22-301 and the frame of the magnify position mark 22-303 in FIG.3A) in the video interface (Video I/F) and OSD (On Screen Display)processor 121, converted to a video signal by the video decoder 107, anddisplayed in the LCD 22 through the liquid crystal panel driver 108.When displaying in an externally connected display unit, a signal outputto a video output (Video Out) terminal can be used.

To create YUV data used for the magnified display, a YUV signal is inputto the image (magnification/reduction) processor 131 (label [D]).

The image (magnification/reduction) processor 131 is an engine used tomagnify or reduce an image (for full-screen display in a sub-screen),and high-speed processing is possible. In addition, existing techniques,such as bi-linear or bi-cubic interpolation and filtering may be used toincrease the image quality. Most of these techniques have conventionallybeen used for magnification and reduction of a still image.

The image magnified or reduced in the image (magnification/reduction)processor 131 is stored in maps 403 (label [E]) and 404 (label [F]) ofthe SDRAM (memory circuit) 104.

Namely, in the method of magnifying or reducing an image wheneverrequested for magnified or reduced display of a playback image in thepresent invention, an image used for magnified or reduced display ispreviously prepared and sequentially transferred (output) according to atransfer request. This is simple and low cost. With the recenthigh-speed (decreased processing speed) hardware structure. (SDRAM), animage can be processed in real time if the size is standard. An image (amoving image or continuous images) displayed in the LCD 22 through theOSD processor 121, or the data corresponding to the frame of thesub-screen 22-302 in the display 22-301 and the frame of the magnifyposition mark 22-303 in FIG. 3A is sequentially moved when movement inthe direction of “up/down/left/right” is instructed (input) from the OKbutton 27, an area of an original image to be magnified is changedaccording to the range of moving the frame of the magnify position mark22-303, and the corresponding magnified or reduced image is sequentiallystored in the maps 403 (label [E]) and 404 (label [F]) of the SDRAM 104.

Thereafter, the magnified or reduced image prepared in the maps 403 and404 of the SDRAM (memory circuit) 104 in the above-mentioned process isoutput to the video decoder 107 (label [G]) through the video interfaceand OSD processor 21, with the magnified display screen and sub-screenoverlaid on the OSD of a square area calculated by the CPU 111.

Therefore, the LCD 22 displays the sub-screen 22-302 and the OSD image22-303 overlaid on the sub-screen 22-302, on the already magnified image22-301 shown in FIG. 3A. In this time, the identifying information(22-303) indicating a magnification changing part is overlaid on amoving image displayed in the display unit (LCD 22), and a magnifiedimage corresponding to the magnification changing part (the image withinthe frame 22-303) to be displayed in the moving image displayed in thedisplay unit (a plurality of image is stored in the above-mentionedmap). When an instruction to change the magnification changing partdisplayed in the moving image displayed in the display unit and therelative position of the moving image displayed in the display unit isinput through the OK button 27, the magnified image corresponding to themagnification changing part is changed according to the relativeposition instructed to change.

The sub-screen 22-302 can be made translucent, for example (theluminance and color are controlled so that the image is displayed in atransparent state through the magnified image 22-301, and displayed inbeing overlaid), by controlling the output level from the image(magnification/reduction) processor 131.

The above-mentioned magnified and reduced images utilize the high-speedimage data transfer with the SDRAM (memory circuit) 104, and can beeasily realized by the above-mentioned simple method.

Playback such as reverse playback, fast forward playback, step playbackand slow playback are the processes before the data is stored in the YUVmap for video display in the image (magnification/reduction) processor131 of the present invention, and can be scrolled while maintaining thestate of magnified display.

Therefore, magnified display is possible while playing a moving image,and this playback image can be enjoyed. Further, a sub-screen alsodisplays a moving image, and the whole image can be grasped even whenmagnifying the image. The method is simple, and the cost is notincreased.

While certain embodiments of the inventions have been described, theseembodiments have been presented by way of example only, and are notintended to limit the scope of the inventions. Indeed, the novel methodsand systems described herein may be embodied in a variety of otherforms; furthermore, various omissions, substitutions and changes in theform of the methods and systems described herein may be made withoutdeparting from the spirit of the inventions. The accompanying claims andtheir equivalents are intended to cover such forms or modifications aswould fall within the scope and spirit of the inventions.

The embodiment of invention is also applicable to a video camera using atape as a recording medium, for example, without modifications. A cameramay be a still camera for shooting (recording) a still image, using alarge capacity memory card as a main recording medium, and an optionalexternal recording medium as an auxiliary recording medium.

1. An image reproducing apparatus comprising: a storage unit configuredto hold a moving image; an input unit configured to providemagnification/reduction of the moving image reproduced; and a controlunit configured to, when an operation to change a magnification of amagnified image is performed via the input unit in a state wherereproduce, to create a moving image of a magnification based on anamount provided by the input unit, and perform special reproduceoperations while maintaining magnified.
 2. The apparatus of claim 1,wherein the special reproduce operations includes reverse reproduce,fast forward reproduce, step reproduce and slow reproduce.
 3. Theapparatus of claim 1, wherein the input unit is a zoom bar forperforming a zoom-in/zoom-out operation at a time of image pickup. 4.The apparatus of claim 3, wherein the magnification increases when thezoom bar is moved to a tele-conversion side (T side), and themagnification decreases when the zoom bar is moved to a wide angle side(W side).
 5. The apparatus of claim 1, wherein during the specialreproduce, the magnified and displayed moving image is scrollable. 6.The apparatus of claim 4, wherein during the special reproduce, themagnified and displayed moving image is scrollable.
 7. An imagereproducing apparatus comprising: a storage unit configured to hold amoving image; a display unit configured to reproduce and display themoving image held in the storage unit; an input unit configured toprovide magnification/reduction of the moving image reproduced anddisplayed in the display unit; and a display control unit configured to,when an operation for changing a magnification of a magnified image isperformed via the input unit in a state where reproduce by the displayunit is temporarily stopped, create and display a moving image of amagnification based on an amount provided by the input unit, and performspecial reproduce operations while maintaining magnified display.
 8. Theapparatus of claim 7, wherein the special reproduce operations includesreverse reproduce, fast forward reproduce, step reproduce and slowreproduce.
 9. The apparatus of claim 7, wherein the input unit is a zoombar for performing a zoom-in/zoom-out operation at a time of imagepickup.
 10. The apparatus of claim 9, wherein the magnificationincreases when the zoom bar is moved to a tele-conversion side (T side),and the magnification decreases when the zoom bar is moved to a wideangle side (W side).
 11. The apparatus of claim 7, wherein during thespecial reproduce, the magnified and displayed moving image isscrollable.
 12. The apparatus of claim 10, wherein during the specialreproduce, the magnified and displayed moving image is scrollable. 13.The apparatus of claim 1, further comprising: a display unit configuredto reproduce and display the moving image held in the storage unit. 14.The apparatus of claim 13, wherein the special reproduce operationsincludes reverse reproduce, fast forward reproduce, step reproduce andslow reproduce.
 15. The apparatus of claim 13, wherein the input unit isa zoom bar for performing a zoom-in/zoom-out operation at a time ofimage pickup.
 16. The apparatus of claim 15, wherein the magnificationincreases when the zoom bar is moved to a tele-conversion side (T side),and the magnification decreases when the zoom bar is moved to a wideangle side (W side).
 17. The apparatus of claim 13, wherein during thespecial reproduce, the magnified and displayed moving image isscrollable.
 18. The apparatus of claim 16, wherein during the specialreproduce, the magnified and displayed moving image is scrollable.